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IN THIS REPORT THE UNITED FEDERATION OF TEACHERS (UFT) 
ANALYZES SPECIFIC DATA FROM THE CENTER FOR URBAN EDUCATION'S 
(CUE) NEGATIVE EVALUATION OF NEW YORK CITY'S MORE EFFECTIVE 
SCHOOLS (MES) PROGRAM AND CHARGES THAT CUE'S CONCLUSIONS ARE 
INVALID. THE UFT MAINTAINS THAT SINCE 18 OF THE 21 MES WERE 
FORMER SPECIAL SERVICE (SS) SCH<X)LS, CUE SHOULD HAVE USED SS 
SCHOOL NORMS AS A BASIS OF EVALUATIOjN RATHER THAN 
STANDARDIZED NATIONAL GROUP NC>RMS. MOREOVER, CUE 
INCONSISTENTLY AND UNSCIENTIFICALLY MATCHED 21 MES WITH ONLY 
EIGHT CONTROL SCHOOLS, AND COMPARED MES STUDENTS WITH 
STUDENTS IN OPEN-ENROLLMENT SCHOO't-S, A HIGHLY MOTIVATED 
SCHOOL POPULATION. IN ASSESSING THE READING ACHIEVEMENT OF 
MES STUDENTS AS COMPARED WITH THAT OF CONTROL STUDENTS, CUE 
USED INVALID TESTS AND IGNORED AVAILABLE READING SCORES WHICH 
SHOWED THAT THE NON-MES SS STUDENTS HAD GAINED LITTLE IN 
READING ACHIEVEMENT. UFT FEELS THAT THE READING 
ACCOMPLISHMENT OF MES STUDENTS CAN BE WITNESSED BY AN 
ACHIEVEMENT CLOSE TO NATIONAL NORMS IN GRADES FOUR TO SIX. 
ALSO, IN ARITHMETIC SIXTH-GRADE MES STUDENTS ARE ONLY ONE 
YEAR BELOW GRADE LEVEL WHEREAS NON-MES SS STUDENTS ARE TWO 
YEARS BELOW. SINCE MES CHILDREN ENTERED THE PROGRAM WITH A 
SEVERE EDUCATIONAL RETARDATION, THESE GAINS SHOW GREAT 
PROGRESS. MOREOVER THE LONGER A STUDENT IS IN AN MES PROGRAM, 
THE BETTER HIS ACADEMIC ACHIEVEMENT. OTHER ASPECTS OF THE CUE 
REPORT WHICH THE UFT REFUTES INCLUDE EVALUATIONS OF TEACHING 
TECHNIQUES (PARTICULARLY UFT'S LESSON OBSERVATION CRITERIA), 
TEACHER AND STUDENT ATTITUDES, SCHOOL CLIMATE, THE EARLY 
CHILDHOOD PROGRAM, AND SCHOOL-COMMUNITY RELATIONS. AMONG 
OTHER RECOMMENDATIONS, UFT SUGGESTS THAT THE BOARD OF 
EDUCATION INVESTIGATE IN WHICH SCHOC'LS THE MES CONCEPT HAS 
BEEN MOST EFFECTIVELY IMPLEMENTED. (LB) 
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Dear Colleague: 

New York City*s More Effective Schools Program, which has only had a short lifetime of 
three years, has been the subject of extravagant praise and condemnation. It is consid- 
ered by many educators to be the best program of total quality education existing in any 
urban center and is being copied in other cities throughout the nation. It has also been 
vilified for producing no improvement in learning while costing a great deal of money. 

During the recent contract negotiations between the Board of Education and the UFT, the 
expansion of M.E.S. was a key issue. The Board contended that an evaluation carried out 
by the Center for Urban Education proved that M.E.S. wfs not achieving results. They sup- 
ported their position by releasing a summary of the report’s conclusions during the sum- 
mer while negotiations were going on. It was impossible for the UFT to answer the charges 
since the entire study was not available, hence the bas.is for the conclusions could not be 



The complete study, entitled "Expansion of the More Effective Schools Program dated Sep- 
tember, 1967, was made available on October 9, 1967. The Board of Education issued the 
report accompanied by a press release supporting the position that children in More Ef- 
fective Schools had not improved in reading and arithmetic, and that this failure was 
based on the lack of innovation in restructuring of the teaching going on in More Effec- 
tive Schools. 

After careful consideration of the entire study.v the United Federation of Teachers makes 
the following charges: 

1. The conclusions drawn are invalid since they are not supported by the facts. 

2. Compared to children in other Special Service schools, those in M.E.S. are 
definitely doing better academic work. 

3. The Board of Education is responsible for misleading the public through its 
issuance of a summary report which could not be refuted. 

A. Both the Board and the Center for Urban Education have acted irresponsibly 
by their issuance and support of an evaluation of M.E.S. which clearly con- 
tains enough distortions. Incomplete information, errors in data collection 
and illogical conclusions to completely invalidate it. 

The following analysis will indicate the basis for our attack on the C.U.E. evaluation, 
as well as our charge that the Board of Education has consistently refused to support t e 
program and has, in fact, taken steps to destroy it. 



analyzed. 



Sincerely , 
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SIDNEY SCHWAGER, Chairman 

UFT More Effective Schools Committee 
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AN ANALYSIS OF THE EVALUATION OF THE MORE EFFECTIVE SCHOOLS 
PROGRAM CONDUCTED BY THE CENTER FOR URBAN EDUCATION 

by 

Sidney Schw^ger, Chairman 
UFT More Effective Schools Committee 



'^This evaluation belongs to the family of short- 
time evaluations conducted in the early years of 
a new program. Such evaluations cannot be con— 
sidered definitive studies of a program’s worth... 
(3, 120)* 



This statement, twice repeated in the study, Is extremely Important, ^e 
UFT believes and will attempt to prove that the children in e 
fectlve Schools are showing progress. We recognize, however, that the 
program is too new to be evaluated in a definitive manner. We are issu- 
ing this report because we are convinced that the Board of ucat on 
attempting to destroy M.E.S. The Board and the communications media h 
^cc^tefthrconcluslons in the C.U.E. report as final. Unless those con- 
clusions are shown to be wrong, the Board of Education will use them as 
the basis for phasing out M.E.S. 

The observers involved in the C.U.E. study would oppose this destruction 
of M.E.S. The report states: "All recommended that M.E.S. 

although most wanted slight cr considerable modifications. (82) We are 
not told how many wanted "slight" and how many wanted 

ifications. The UFT agrees that changes in the program are , 

we have submitted many recommendations aimed at its improvement, h 
of Education has, however, refused to follow any of them. ^ 

fact, illustrated their desire to destroy the More Effective schools by 
taking two positions from each school and by completely eliminat J’-S ^ 
centralized administration without which there is the real likelxhood of 
21 different programs rather than one More Effective Schools Progi-am. 

An experimental program of the scope of M.E.S. must have a distinctive 
point of view. This is especially true because of the great emphasis 
needed in areas of heterogeneous grouping, teacher training and parent in- 
volvement. An office and staff assigned to implement these special needs 
are vital. While M.E.S. is forced to function without direction, lesser 
programs which cannot possibly affect chixurcn s learning ^ ® 
that M.E.S. can and does are allowed to maintain administrative staffs. 

The refusal of the Board to follow the same policy for M.E.S. is contrary 
to its own procedures and can only be considered to be a deliberate act 
aimed at the elimination of M.E.S. 



*( ) Numbers in parentheses refer to pages of C.U.E. evaluation, Septem- 

ber, 1967. 
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TECHNIQUES FOR MEASURING ACADEMIC GROWTH 



Use of Urban Norms 

We are told that "In the areas of achievement in arithmetic and reading, 
Sed as bases of cos^arlson the nonns for -b- schools 
the publisher." (28) These urban norms are 1 to 2 months below ^^tion 
noMs and are more representative of large urban centers according to 

the report. 

1. The "urban norms" which are used are referred to by the test 
publisher as "total group norms" rather than ‘ - 

The norms were standardized on a cross section of the popula- 
tion of school systems in 48 states. None of the standardi- 
zation was conducted in any large urban area in the en re 
nation. 



2. In a lecture dealing with testing the disadvantaged child, 
Dr. Roger Lennon, Director of Testing for Ear court. Brace 
& World, Inc., the company which publishes the tests use 
in the study said: "If there is either serious, notable, 

significant deprivation for one examinee relative to an- 
other, or marked difference in motiviation from one exami- 
nee to another, it is impossible to interpret the Perform- 
ance of these two examinees in the same fashion. (.A; 

Most educators strongly agree with this statement. The only 
norms that should be used to compare M.E.S. are norms tor 
New York City’s Special Service schools. Hai these norms 
been developed and used, M.E.S. would be clearly ahead. 



Use of Control Schools 

The study states: "Achievement was also compared In the matched control 

and M.E. Schools." (28) 

1. There Is no attempt by C.U.E. to consistently 

in M.E.S. with achievement in control schools. In the s 
dealing with arithmetic and reading achievement, there are ten 
tables of statistics. Only two of the ten tables 
parlsons with the control schools, and these two t« as t 
that M.E. Schools are doing better than control sf °°f • 

One of the two tables follows (Table 10). The other Is Table 
Number 11 which Is Included to Illustrate the next point. 

A study which does not provide a clear comparison a control group 

cannot be accepted as scientifically valid by any careful observer. 

(A) "Testing the Culturally Disadvantaged Child," Roger ^ 

Director, Test Department, Harcourt, Brace 6. World, 

1964. Lecture on Problems In Education, Boston Schools Committee. 
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Table 10 

Median Reading Grade Equivalents October 1966 and April 196? » 
and Gains During 1966-67 School Year, Old and Nev MES 
and Control Schools, by Grade 



Type of 

Grade School 



Median Reading Grade 
October 1966 April 19o7 



2 Old MES 

New MES 
All MES 
All Control 

3 Old MES 

Nev MES 
All MES 
All Control 

U Old MES 

Nev MES 
All MES 
All Control 

5 Old MES 

Nev MES 
All MES 
All Control 



1.8 


2.6 


1.8 


2.6 


1.8 


2.6 


1.7 


2.3 


2.5 


3.5 


2.U 


3.U 


2.U 


3.U 


2.U 


3.2 


3.3 


3.9 


3.2 


u.o 


3.3 


3.9 


3.2 


3.7 


3.8 


U.5 


3.7 


U.6 


3.7 


U.6 


3.8 


U.3 



6 Old MES 5.1 5.5 

New MES U.6 5.5 

All MES U.9 

5.0 5.5 



Gain 

.8 

.8 

.8 

.6 

1.0 

1.0 

1.0 

.8 

.6 

.8 

.6 

.5 

.7 

.9 

.9 

.5 

,k 

.9 

.6 



All Control 



5 



2 



. In all but one case where M.E.S. and control schools are compared, 
the comparison is between the 21 M.E. Schools as a group and the 
8 control schools as a group. To obtain a control group, a set 
of 8 schools was "selected because of their similarity to an M.E. 
School in terms of location and pupil population." (1) Scientif- 
ic method would demand that any group comparisons therefore be 
made between the 8 control schools and their 8 matched schools. 
Where this more exact and valid procedure was used, it showed the 
M.E. Schools scoring consistently higher than control schools, . 

(54) Table 11, following, illustrates this point. 



Table 11 

Comparison of Gains in Median Grade Equivalents 
in ME and Control Schools by Grade, 
October 1966 to April 1967. 







Grade 






2 


3 




5 




School 






















April 


Gain 


Pair 


Type 


Oct. 


April 


Gain 


Oct. 


April 


Gain 


Oct. 


April 


Gain 


Oct. 


A 


MES 


1.7 


2.1* 


.7 


2.7 


3.5 


.8 


3.U 


h.O 


.6 


3.7 


4.1 


.4 




C 


1.7 


2.1* 


.7 


2.1* 


3.1 


.7 


3.3 


3.7 


.!» 


3.U 


3.9 


.5 


B 


MES 


2.3 


2.9 


.6 


2.8 


3.6 


.8 


3.9 


h.9 


1.0 


5.0 


5.8 


.8 


C 


1.8 


2.5 


.7 


2.6 


3.7 


1.1 


3.6 


k.k 


.8 


U.6 


5.1 


.5 


C 


MES 


1.7 


2.3 


.6 


2.3 


3.2 


.9 


3.1 


3.3 


.2 


3.5 


4.4 


.9 




C 


1.7 


2.2 


.5 


2.3 


3.0 


.7 


2.0 


3.3 


.5 


3.»* 


4.0 


.6 


D 


MES 


1.7 


2.6 


.9 


2.1* 


3.3 


.9 


3.2 


3.8 


.6 


3.7 


4.5 


.8 




C 


1.7 


2,k 


.7 


2.3 


3.1 


.8 


3.2 


3.6 


.!» 


1*.0 


4.1 


.1 


E 


MES 


1.9 


2.8 


.9 


2.9 


3.6 


.7 


3.3 


k.2 


.9 


i*.0 


4.9 


.9 




C 


1.9 


2.8 


.9 


2,k 


3.5 


1.1 


3.6 


k.2 


.6 


4.2 


4.7 


.5 


r 


MES 


1.8 


3.2 


1.1* 


2.3 


U.3 


2.0 


3.1 


3.8 * 


• .7 


3*5 


4.9 


1.4 




C 


1.6 


2.3 


.7 


2.1* 


3.2 


.8 


3.2 


3.8 


.6 


3.5 


4.3 


.8 


G 


MES 


1.6 


2.3 


.7 


2.1 


3.0 


.9 


3.1 


3.9 


.8 


4.2 


4.4 


.2 




C 


1.5 


2.1 


.6 


2.2 


3.0 


.8 


3.0 


3.3 


.3 


3.3 


4.0 


.7 


H 


MES 


2.0 


2.8 


.8 


2.6 


3.»* 


.’8 


3.7 


1+.3 


.6 


4.0 


4.6 


.6 




C 


1.7 


2:h 


.7 


2.5 


3.3 


.8 


3.1 


3.7 


.6 


4.0 


4.5 


.5 


All 


Mean 


.!»♦ 


CO 

m 

• 


.15 


.12 


.25 


.12 


.12 


.28 


.15 


.15 


• 

U) 

oo 


.25 


Pairs 


Diff. 


















No. of times 
ME School 
higher 


k 


6 


5 


5 


6 


5 


5 


5 


6 


4 


8 


6 


No. of times 
Control School 
higher 


0 


0 


1 


2 


1 


2 


2 


0 


1 


2 


0 


2 


No. of times 
no difference 


k 


2 


2 


1 


1 


1 


1 


• 

3 


1 


2 


0 


0 



Omitted at Lower Read inpj Levels. 

.... rT;LiM'“ri.Lr« ™.s ifr 

s.sr.s.*;s: 

s'r;otrs-rs.u, h„.». .« 

not done. 

It 1= important because there are too many children in 

st::rrK jr.;rxr“urf : 

ss;3.ss.’;2 r s.'s»iS. s- ~^u .hu 

fact convincingly. 



TTfiP of Longitudinal S tudies 

=.t".-u»srr,frnr<:”.5r 



sons : 



1. They do not indicate comparisons with control or Special Service 
schools . 

2 They are not longitudinal studies. A longitudinal study 

meSuS the growth of .v,cr1y the same stude.^ two tables, 

of time studied. In the seven <=°“Pf ”'‘^®.i”the f^st two -- 
^ have fewer subjects in the third 

h"avr:e:rurertriorgit!Lfal g;owth of the same -“dents only. 

If anv students were lost in the final 

first' two years should have changed to omit these students. These 
taSlL No.% and No. 14 can be found further on in this report. 



^ hpadine Scores huring the Summe x 

1 Tn one table, the C.U.E. report indicates that the expected 

growth in reading scores between the (ge) 

liven in October of the same year is a 8-" L of 

available statistics indicates that test qc- 

Servlce schools in Manhattan, Bronx, and Brooklyn f- 

tober of 1966 show that only 35% of those schools g ’ 

mocit of these gained only 1 month. The majority, 65/4, either 
most of tnese gainea y statistics were readi- 

were unchanged (22%) or tell ) Rureau of Educa- 

ly available to the C.U.E. research staff f 

tional Research. Why did they not use them to test their ass p 

tion of growth from May to October? 
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2. The table which C.U.E. used to supposedly illustrate the infor- 
mation discussed above follows, along with a more accurate 
analysis of its impact. 



Table 12 

Changes in Reading Level, Fall to Spring and Spring to Fall, 
MBS, Octo^r I 96 U to April 196? 



Year 1 

Grades Statistic Oct. May 

*6k '65 


Year 2 
Oct . May 

'65 '66 


Year 3 

Oct . April 

'66 '67 


All Three Years 


2,3,** Median 1.8 2.U 


2.6 3.7 


3.3 3.9 




Fall to Spring 








Change +.6 


+1.1 


+.6 




Expected Change +.7 


+.7 


+.6 




Net Change -.1 


+.k 


0 


+•3 


Spring to Pall +• 


2 -0. 


k 




Change 








Expected Change +.3 +. 


3 




Net Change 


1 -0. 


7 


•• 0 8 


3,J*,5 Median 2.6 3.»* 


3.1* U.2 


3.8 U.5 




Fall to Spring 








Change -f.B 


+.8 


+.7 




Expected Change +.7 


+.7 


+.6 




Net Change -*-.l 


+.1 


..1 j 


..3 


Spring to Fall 


0 






Change 








Expected Change 


,3 +. 


3 




Net Change -.3 

1 

1 


J 


-1.0 


1*,5,6 Median 3.0 l*.l 


5.2 


5.1 5.5 




Fall to Spring 








Change 1.1 


+.8 


+.1* 




Expected Change .7 


+.7 


+.6 




Net Change 


+.1 


-.2 


+ .3 


Spring to Pall + 


• 3 ” - 


.1 




Change 








Expected Change *.3 + 


.3 




Net Change 


0 




-.u 







k-'-Shi 







The actual fact which should be apparent from this table is that over a 
teaching span of 26 school months from October, 1964, to April, 1967, 
the following growth in reading was made. 

Classes moving from grade 2 to 4 — 21 months gain in reading 

Classes moving from grade 3 to 5 — 19 months gain in reading 

Classes moving from grade 4 to 6 ~ 25 months gain in reading 

This proves that classes moving from grade 4 to grade 6 were only one 

school month away from the national norms. C.U.E. conclusions failed 
to reveal this truly remarkable growth. The other two comparisons are 
also favorable based on what we know about expected growth in Special 
Service schools, although not as good as progress in grades 4-6. 



Retesting M.E.S. Children in June 

A sample of M.E.S. children was retested at the end of June, 1967 to see 
if there had been a decline since April. C.U.E. project staff adminis- 
tered and scored the tests. The report states; "The presence of a 
stranger coming in to administer a reading test was viot, in^^itself, a 
factor sufficient to distort the class average performance." (65) 

1, To reply to this quote from the C.U.E. report, we refer again 
to Dr. Lennon; "These (disadvantaged) pupils need to feel 
that in giving tests, the teacher is deeply concerned about 
he .7 well they do, that she wants to have them do their best, 
that she wants the test information only so that she can help 
them." (B) None of this applies to the false situation con- 
ducted in June. College students, many with no experience in 
testing' and none known to the children entered classrooms in 
late June to administer tests when children were set toward va- 
cation time. 

Some of the practices of the examiners that made the June tests 
invalid include ; 

a) Trips were canceled to enable tests to be administered. 

b) Gym and other special and highly desirable classes were 
canceled to allow the tests to be administered. 

c) Timing was so poor that some tests ran into lunch hours 
and dismissal time. 

d) The "testers" could not maintain reasonable order and 
discipline. 

e) Some tests were administered late in the afternoon. 



(B) Ibid. 
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2. It is also important to note that, as usual, the researcher 
failed to provide any comparative statistics for control or 
Special Service schools. The tests were not even adminis- 
tered in control schools. 

The Inclusion of any reference to the June test must be con- 
sidered as an examp .e of unscientific and uninformed research. 

CONCLUSIONS RELATED TO ACADEMIC GROWTH 

We have analyzed the raethods used to arrive at conclusions and have found 
them seriously lacking an essential scientific base. It is necessary, 
however, to go further and to scrutinize the actual conclusions reached 
by the C.U.E. report. It will become clear that even the incomplete and 
unscientifically drawn data provided do not lead to the negative conclu- 
sions made by C.U.E. , but rather support the contention that children in 
M.E.S. are doing better. 

Conclusions Related to Arithmetic Achievement 

The C.U.E. report states: "Overall, one would conclude that the M.E.S. 

program has not had any significant or consistent effect on children’s 
performance in arithmetic problem solving and concepts." (48) 

1. In "normal" schools throughout the nation, children are expect- 
ed to make one year’s gain in a year. Normal growth for New 
York’s Special Service schools is much less. It is known that 
children in Special Service schools increase their retardation 
every year. They are nearly 1 year retarded at the end of the 
third grade and almost 2 years behind by the end of the sixth 
grade. Both tables dealing with arithmetic achievement in M.E.S. 
show the children’s improvement over this trend. Third year pu- 
pils are only 1 month behind and sixth year pupils are only one 
year behind. 

Table 7 

Graide Equivalents in Arithmetic Problem Solving and Concepts 
Test, Medlaas, Status in Relation to Norms and Range; 
by Grade and Type of School. 



Grade 2 3 U § 6 



Statistic 


Old New All 


Old 


New All 


Old New 


All 


Old 


New All 


Old 


New 


All 


Mean 


2.8 


2.7 


2.S 


3.4 


3.5 


3.5 


4.3 


3.9 


4.0 


4.8 


4.8 


4.8 


5.8 


5.4 


5.6 


Norm 


2.6 


2.6 


2.6 


3.6 


3.6 


3.6 


4.6 


4.6 


4.6 


5.6 


5.6 


5.6 


6.6 


6.6 


6.6 


Status in 
Relation to 


+ .2 


+.1 


+.2 


-.2 


-.1 


-.1 


-.3 


-.7 


-.6 


-.8 


-.8 


-.8 


-.8 


-1.2 


-1.0 


Norm 
































Lowest School 
































Median 


2.U 


2.3 


2.3 


2.8 


2.8 


2.8 


3.5 


3.5 


3.5 


4.4 


4.2 


4.2 


5.0 


5.1 


5c0 


Highest School 
Median 


3.U 


3.3 


3.U 


U.U 


3.9 


U.U 


5.4 


4.3 


5.4 


5.6 


5.3 


5.6 


6.5 


5.9 


6.5 


Overall Range 
by School 


1.0 


1.0 


1.1 


1.6 


1.1 


1.6 


1.9 


.8 


1.9 


1.2 


1.1 


1.4 


1.5 


.8 


1.5 



er|c 
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2. The so-called "longitudinal" study indicates that over a 26 
school month testing period from grades 3 to 5, retardation 
increased only 2 months » and from grades 4 to 6 retardation 
actually decreased 4 months. The 2-year studies showed a de- 
crease in retardation of 5 months from grade 4 to 5 and an 
arrest of any further retardation from grade 5 to 6. This 
indicates progress above national norms in grades 4-6 of old 
M.E.S. and grades 5-6 of new M.E.S. , and only slightly below 
national norms in grades 3-5 of old M.E.S. Since children 
come into M.E. Schools severely retarded, making gains better 
than, equal to, or slightly below national norms while in 
M.E.S., represents great progress. 



Table 8 

Longitudinal Study in Arithmetic 
Achievement, Old and New MES 



Date of No. of Norm at Comparison Net Change 



Grade 


Test 


Children 


Median 


Testing 


with Norm 


by May 


During 
•66- '67 


by Mar. 
•67 


Old MES 
















3 


Oct. ’64 


628 


2.6 


3.1 


-.5 








U 


May ' 66 


628 


4.5 


4.8 


-.3 


+ .2 


-.4 


-•2 


5 


Mar. '67 


531 


4.9 


'5.6 


-.7 








4 


Oct. '64 


656 


3.0 


4.1 


-1.1 








5 


May ' 66 


656 


5.1 


5.8 


-.7 


+ .4 


0 


+ .4 


6 


Mar. '67 


408®” 


5.9 


6.6 


-.7 








New MES 
















4 


Ocf.* '65 


741 


3.1 


4.2 


-1.1 








4 


May ' 66 


741 


4.2 


4.8 


-.6 


+ .5 


0 


+ .5 


5 


Maur. '67 


383 


5.0 


5.6 


-.6 








5 


Oct. '65 


694 


4.0 


5.2 


-1.2 








5 


May ' 66 


694 


4.5 


5.8 


-1.3 


-.1 


+ .1 


0 


6 


Mar. '67 


102® 


5.4 


6.6 


-1.2 









^The Attrition here reflects the fact that few ME schools have a sixth grade. 
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These figures prove the exact opposite of C. U.K.'s 
compared to Special Service school standards, M.E. 



conclusions. When 
S. did very much 



better. 



Conclusions Related to Readi ng Achievement 

1. The same analysis must be applied to the so-called "longitudi- 
nal" study of reading progress (60). The small increase in 
retardation over the 26 months measured in grades - an 
and the maintenance of growth equivalent to national norms n 
grades 4-6 are proof of positive accomplishments of M.E.b. 



Table lU 

Longitudinal Analysis of Progress in Reading, 
MBS, October 1964 through April 1967, 
Median Reading Grade 







Date of 
Test 


Median 

Grade 


Norm at 
Testing 


Compgirison 
with Norm 


NET Change 


by 

4/67 


by 5/66 


During 
'66- '67 


2 


784 


Oct. '64 


1.8 


2.1 


-.3 








3 


784 


May '66 


3.7 


3.8 


-.1 


+ .2 


-.6 


-.4 


4 


744 


Apr. '67 


4.0 


4.7 


-.7 








3 


759 


Oct. '64 


2.7 


3.1 


-.4 








4 


759 


May ' 66 


4.2 


4.8 


-.6 


-.2 


-.3 


-.5 


5 


697 


Apr. '67 


4.8 


5.7 


-.9 








4 


567 


Oct. '64 


3.2 


4.1 


-.9 








5 


567 


May '66 


5.2 


5.8 


-.6 


•^.3 


-.3 


0 


6 


395 


Apr. '67 


5.8 


6.7 


-.9 









2. The comparison of reading levels for children who had been in 
the More Effective Schools lor 3 years with those who had been 
in only part of the time (67) is also extremely positive. The 
C.U.E. report concludes that although continuous education in 
M.E.S. made a difference, children in that group were still ,6 
of a year behind in grade 4, and .8 behind in grades 5 and 6. 



o 
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As has been indicated before, these levels of retardation show 
great improvement over what can be expected in Special Service 
schools. The clear fact is that children with 3 full years in 
M.E.S. scored from 5 to 9 months better than children who had 
come into M.E.S. during the 3 years. 



Table l6 

Conparleon of Reading Levels for Children with 
Different Educational Histories by Grade, 

Old ME Schools Only. 



Current 



Grade 


Gp. 


Education 


MES 


Median 


__Q3 . 


. Q1 


IQR 


Nona 


U 


1 


Iftibroken 


Pull 


k,l 


U.9 


3.14 


1.5 






2 


Broken 


Full 


3.9 


h,6 


3.2 


l.U 


U.T 




3 


Broken 


Partial 


3.6 


U.3 


3.1 


*1.2 




5 


1 


Unbroken 


Pull 


U.9 


6.0 


U.l 


1.9 






2 


Broken 


Full 


U.7 


5.7 


3.9 


1.8 


5.7 




3 


Broken 


Partial 


U.U 


5.U 


3.7 


1.7 




6 


1 


Unbroken 


Full 


5.9 


8.7 


U.8 


3.9 






2 


Broken 


Full 


5.6 


7.3 


U.U 


2.9 


6.7 




3 


Broken 


Partial 


5.0 


7.0 


U.O 


3.0 





The preceding evidence must surely make every open-minded inquirer ask 
how C.U.E. or the Board of Education can so strongly back a report with 
so many of its procedures and conclusions open to absolute refutation. 
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Comparison of M.E.S. With Special Service Schools in Reading 

The Bureau of Educational Research at the Board made available to the UFT 
the average reading scores for each school in the city on grades 2, 3, 4, 

5 and 6 for the Metropolitan Reading Achievement Tests given in September, 
1966 and in April, 1967, In addition, they made available the number of 
students in each school who were tested. From these figures the UFT was 
able to compute the average reading score for each test for all Special 
Service school children and for all M.E.S. children. The technique used 
was the technique of the weighted average through which each school aver- 
age is represented in proportion to the number of students in that school 
who were tested. 

The results are attached. In evaluating them, we should keep in mind the 
following facts. The Special Service category includes many atypical 
schools. For instance. Public School 76 Queens, a Queens College experi- 
mental school, heavily supported by Federal funds is a Special Service 
school, and its scores are included in the overall Special Service aver- 
age. Similarly, college demonstration schools are included as are many 
other Special Service schools where there are special projects. Also in- 
cluded are certain Special Service schools which enroll large numbers of 
middle class children — for instance. Public School 7-8 Brooklyn, the 
paired schools in Brooklyn Heights, many of the schools on the West side 
of Manhattan, the paired schools in Queens, the schools on the lower East 
side that take children from the Amalgamated Housing Coop, etc. The 
scores for the children in Central Harlem, the central area of Bedford- 
Stuyvesant, and other similar areas are a good deal lower than the Spe- 
cial Service averages. 

Technically, the old M.E. Schools were three years old at testing time. 
Actually, the first half-year was spent in organization and the prepara- 
tion of facilities. The program in the old schools may therefore be 
said to have been 2-1/2 years old at testing time. The program in the 
new schools was two years old at testing time. Only the M.E.S. second 
grade, therefore, contains children who started in the M.E.S. program. 

Even there we did not have at testing time children who had gone 
through the fi.E.S. pre-kindergarten. Nevertheless, in April of 1967, 
second grade M.E.S. children read on the average two months above the 
national norm. Third graders who, at the earliest entered the program 
in first grade read one month above the national norm. The upper three 
grades contained no child who started his schooling in an M.E. School. 
Retardation has not been completely overcome in these grades. But the 
results are still far better than in the Special Service schools. We 
may hypothesize that the normal child who starts in the M.E.S. pre- 
kindergarten will be reading at or above grade level in the sixth 
grade if the tendencies of the second and third grade continue. 

We must also bear in mind that each grade contains a substantial number 
of children who transferred into an M.E. School district, having re- 
ceived their previous education in a Special Service school. Thus, not 
all of the children in any grade have received two or three years of ed- 
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ucation in an M.E. School which might have helped them to overcome the 
retardation they suffered in the Special Service schools. (The C.U.E. 
study indicated that the longer the child was in the M.E. Schools the 
better he did, and that children who had received all of their educa- 
tion in M.E.S. did the best.) 

Of the 21 M.E. Schools, 18 were formerly Special Service schools, and 
three were non-Special Service schools in transitional areas. The 3 
M.E. Schools, formerly non-Special Service schools, did much better, 
than the 18 M.E. Schools which v;ere formerly Special Service schools. 
We hypothesize that these three schools have kept a substantial middle 
class population. Statistical studies made indicate that the specific 
weight of these three schools does not materially affect the figures 
for the 21 schools. In most grades in most tests there is no effect 
at all. In two cases the average is increased by two months, and in 
the other cases by one month or by no months. It seems fair to in- 
clude these three schools in the overall average because we do include 
in the Special Service schools the averages for schools with substan- 
tial middle class populations or where there are special projects. 

AVERAGE READING SCORES OF PUPILS IN 
YORK CITY*S SPECIAL SERVICE AND M.E.S . SCHOOLS 



o 

lERlC 



GRADE 


TYPE OF 
SCHOOL 


TESTING — MONTH & YEAR 
SEPTEMBER. 1966 


TESTING — MONTH & YEAR 
APRIL, 1967 






No. Tested 


Aver. 


Norm 


No. Tested 


Aver. 


Norm 


2 


Sn.Ser. 


36,940 


1.7 


2.0 


38,08f> 


2.4 


2.7 


2 


M.E.S. 


2,696 


1.9 


2.0 


2,643 


2.9 


2.7 


3 


Sp. Ser. 


37,164 


2.5 


3.0 


37,259 


3.3 


3.7 


3 


M.E.S. 


2,265 


2.7 


3.0 


2,311 


3.8 


3.7 


4 


Sp. Ser , 


36,973 


3.2 


4.0 


37,062 


3.9 


4.7 


4 


M.E.S. 


2,352 


3.5 


4.0 


2,374 


4.3 


4.7 


5 


Sp • Sgic • 


34,613 


4.0 


5.0 


34,780 


5.0 


5.7 


5 


M.E.S. 


2,163 


4.2 


5.0 


2,125 


5.4 


5.7 


6 


Sp.Ser . 


30,772 


4.9 


6.0 


30,217 


5.6 


6.7 


6 


M.E.S. 


965 


5.5 


6.0 


948 


6.6 


6.7 



I 



*Eugene Blum, UFT Special Representative, drew up the table presented 
above. Mr. Blum holds an M.A. Degree from Columbia University in 
Mathematical Statistics. 
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One must observe on the basis of this study that if second grade child- 
ren in Special Service schools were reading at 2.9 at a time when the 
national norm is 2.7, there would certainly be no problem. Indeed, New 
York City teachers would be national heroes. If a program had been in- 
troduced in all the Special Service schools which in the second or 
third year of its operation had resulted in an average reading grade 
for sixth year pupils of 6.6 at a time that the national norm is 6.7, 
we might not be national heroes, but we certainly would not be faced 
with social catastrophe. 



TEACHING TECHNIQUES 



The C.U.E. study is also highly critical of M.E.S. in the area of teach 
ing techniques. The analysis of teaching techniques was accomplished 
by "professional educators" or social scientists visiting the More Ef- 
fective Schools and the control schools to observe classes and conduct 
interviews. The lessons observed were rated on a form called the 
I.L.O.R. (Individual Lesson Observation Report). We are told that the 
basis for evaluative conclusions is a comparison with findings in con- 
trol schools and in schools involved in the Free Choice Open Enrollment 
Program. 



Qualifications of Observers 

1. Twenty- two of the thirty-seven observers listed are on the fac- 
ulty of the College of the City of New York. This cannot be 
considered a truly independent or representative panel of ob- 
servers. Working together on the same faculty can cause in- 
breeding of ideas and a similar point of view, and may account 
for the high agreement reported on rating scales. 

2. There is no evidence that any of the observers had any experi- 
ence in elementary schools. The 1966 evaluation conducted by 
C.U.E. used observers who had "an extensive background of 
teaching at the elementary level." (C) 

Observation of Lessons 

1. This report states: "No attempt is made on the I.L.O.R. to 

describe for the observer what each of the rating scale points 
means in terms of actual classroom behavior." (15) Thus no 
guidelines are provided observers in rating such vague crite- 
ria as "level of creativity" or "depth of the lesson," and the 
instrument is consequently subject to considerable individual 
interpretation as to how the criteria apply. It is possible, 
then, for observers to give a lesson the same mark for entire- 
ly different, even opposing reasons. This lack of standardi- 

(C) Evaluation of the More Effective Schools Program by Center for Ur- 
ban Education, August 31, 1966, Page 2. 
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zation clearly weakens the precision of the I.L.O.R. as a re- 
search instrument* 

2. The use of the I.L.O.R. led to the conclusion that there has 
been no radical restructuring of the methods of instruction. 

It is difficult to understand this conclusion since other data 
also based on the I.L.O.R. seem to disprove it. We are told: 

a) "The lessons in M.E.S. were above average both in quality 
and the amount of material covered. (69), 

b) "Typical M.E.S. lessons showed above average or exception- 
al organization and planning." (69) 

c) "Discipline and control achieved ware good or excellent in 

M.E.S. lessons." (70) 

d) M.E.S. lessons related more to children’s own experiences. 

e) Of the eleven aspects related to teacher functioning com- 
paring M.E.S. and control schools, the M.E.S. were rated 
better in every case . 

Any logical person must interpret these findings as evidence that there 
has been a radical improvement in the quality of teaching in More Effec 
tive Schools. 



FURTHER CONSIDERATIONS 



We have dealt with two major areas of the report, academic achievement 
and teaching techniques. There are other sections which are also op®!' 
to question. We will deal with those now to further prove how unreli- 
able the C.U.E. study is. 



Inclusion of Data For Open Enrollment Schools 

It is difficult to understand why test data for open enrollment schools 
are included in the study. These are not a control group. The popula- 
tion is a very special one, and the children in open enrollment receiv- 
ing schools are recognized generally as being highly motivated by pa- 
rents. One might conclude, following the trend evident throughout the 
evaluation, that since M.E.S. were clearly better than control schools, 
other extraneous test data were included to lessen the impact of the 
M.E.S. superiority. 



o 
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Children's Perception of Their Class 

The evaluation concluded that the.M.E.S. Program had not had "pronounced 
impact" (38) on children* s perception of class and classmates. The term 
"pronounced impact" is, unfortunately, not defined. The facts, however, 
indicate that 15 out of 19 responses on the "My Class" instrument were 
clearly favorable to M.E.S. over the control schools, and that more' 
children in M.E.S. had positive perceptions of their class than those in 
control schools had. 



Children* s Perception of Their Teacher 

The unscientific bias of the C.U.E. report is clearly Illustrated in the 
discussion of children* s reactions to the statement; "Teachers expect 
you to work too hard." (43) The children in control schools overwhelm- 
ingly indicated this to be true in contrast to reactions of children in 
M.E.S. Most people would consider this response clearly favorable to 
M.E.S. The evaluation, however, judged this response to be favorable 
toward control schools, based on an article in The New York Times . This 
type of subjective reasoning does not belong in a carefully conducted 
study. 



Methods of Instruction 



The evaluation concluded that the methods of instruction have not im- 
proved, and "This is one clear clue to the lack of overt evidence of im- 
proved functioning by the children." (70) If the reader accepts previ- 
ously stated evidence that the children in M.E.S. have definitely im- 
proved their functioning, the evaluation* s conclusions again become sus- 
pect. 



Teacher Attitude and Behavior 

The evaluation draws no obvious comparisons in the analysis of teacher at 
titude and behavior in class. (78) The results are described in general 
terms and no conclusions are stated. An analysis of the result, however, 
clearly indicates that teachers in M.E.S. received a consistently more 
positive rating than those in control schools. 



Using Small Class Size 

The evaluation indicates that the observers felt that the MtE.S. teach- 
ers did not take advantage of the smaller class size in teaching. How- 
ever, how one takes advantage of small class size is subject to differ- 
ing educational philosophies and methods. We do not know how the ob- 
servers made their conclusions. It is quite possible that small class 
size per se might result in better teaching. This is never considered 
in the evaluation. 



o 
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General School Cliinate 



In the comparison of the general school climate in M.E.S. and control 
schools 9 the conclusions drawn need emphasis. 

1. M.E.S. classrooms and school buildings (81) were above aver- 
age and often extremely attractive. 



2 "In terms of climate, the observers were laudatory about the 
general climate and specific attitudes in M.E* Schools, and 
the ratings were consistently and dramatically more pos ve 
in this respect than in control schools. (81) 



3. "In terms of their overall ratings, half of the observers 

would have felt enthusiastic or strongly positive about send 
ing their child to an M.E. School, a feeling not one of the 
observers had about any control school. . . . All observers 
felt the instruction they had seen in the M.E. School was 
worth more than the average school day, whereas the instruc- 
tion they had seen in the control school was not. C8Z; 



Early Childhood Program 



In the chapter dealing with the evaluation of early chlld^od g“des , 
there Is no comparison with control schools In any way. ^ 

It Impossible to draw any comparative conclusions. The 

fered considered by themselves, do develop an extremely posit! p 

turf^f eafly childhood education In M.E.S. C.U.E.'s observations are 

included below: 



1. "...observers saw children functioning with above average in 
terest and enthusiasm and above average participation and 
volunteering." (91) 



2 . 



"...observers rated as above average, the quality, depth an 
amount of material covered in the lesson, creativity and im- 
agination, and the extent to which a foundation was estab- 
lished for future lessons." (96) 



3. "(Observers)... obtained an even more positive picture of the 
school than the highly positive picture we have already re- 
ported for the observers who saw the middle grades. (.9/; 



4. 



"About two-thirds (of the observers) reported enthusiasm or 
strong positive feelings about having a child of their own 
in the school." (99) 
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School-Community Relations 



At a time when New York is experiencing mounting difficulties in devel- 
oping and maintaining good relations between the school and the commu- 
nity, one conclusion of the evaluation stands out. In the areas of 
overall school climate and staff attitude as sensed by observers, and 
as reported by administrative staff and teaching faculty, it is clear 
that in most of the schools in which the M.R.S. Program has been estab- 
lished, there was an atmosphere end climate characterized by enthusiasm, 
interest and hope Moreover, parents and community, too, have re- 

sponded with interest and enthusiasm to the M.E.S. Program in their 
neighborhood schools. The creation of such positive feelings and cli- 
mates in a school system which in recent years has evidenced consider- 
able internal stress and school- community conflict is an important ac- 
complishment." 

No school will be able to educate its children if there is unrest and 
antagonism between parents and teachers. The fact that parents and 
teachers work well together in More Effective Schools so that educa- 
tion is not interrupted should be reason enough to continue and expand 

M.E.S. 



CONCLUSIONS 



The United Federation of Teachers, while supporting the continuation 
and expansion of M.E.S. and defending the program against unjust at- 
tacks, does not claim that M.E.S. is perfect. There is definitely 
need for improvement in many aspects of the More Effective Schools 
Progranr*as it is presently functioning. There is obviously tr'uth in 
the charge made a number of times in the evaluation that there 
great variation from school to school on every criterion considered. 

We applaud the suggestion made that the next step in research related 
to M.E.S. is to "seek to identify what distinguished the schools in 
which the M.E.S. concept has been more effectively implemented from 
those in which it has been less effectively implemented. (120) One 
must wonder why the Board of Education has never attempted this type 
of evaluation. There is obviously need for its inception, and it 
should involve both teachers and parents. 

We also concur with the charge that "only portions of the M.E.S. con- 
cept have been implemented." (123) The "Report of the Joint Planning 
Committee For More Effective Schools" of May, 1964 was unanimously 
adopted by the Board of Education. It was agreed that it was neces- 
sary to implement a comprehensive program because limited improvements 
are futile. It is clear that this worthy plan was never executed. 

Some aspects of the program were never introduced in any schools and 
others were introduced in only some of the schools.... M.E.S. is 
criticized because it has not solved all of the problems of children 
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in two or three years. No reasonable person could expect these schools 
to be functioning on a level equal to national norms in so short a time. 
It is even less likely when we realize that the original M.E.S. plan, 
aimed at attacking all of the problems of children, has never had a 
chance to function. 

The public interest can be served, and faith in our educational leaders 
restored if the following steps are carried out. 

1. The Board of Education should instruct the Bureau of Education- 
al Research to complete and make public its own analysis of pu- 
pil achievement in M.E.S. as they have done in the past. 

2. A new research group, agreeable to the Board and the Union 
should be given complete freedom in analyzing the current data 
and carrying on a r search program during the next two years 
while the program remains intact. 

3. In order to restore direction to the presently leader less M.E.S. 
Program, and to prove its interest in true and sincere exper- 
mentation, the Board must immediately set up a Citywide More 
Effective Schools District along guidelines developed jointly 
by the United Federation of Teachers, Citywide M.E.S. Parents 
Association and representatives of M.E.S. supervisors. It 
should also supply the Citywide M.E.S. District with a complete 
staff, and charge that staff with the responsibility for imple- 
menting in all of the More Effective Schools the practices 
found to work in the best More Effective Schools. 
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